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Abstract — We consider the problem of rate allocation in a 
Gaussian multiple-access channel, with the goal of maximizing 
a utility function over transmission rates. In contrast to the 
literature which focuses on linear utility functions, we study 
general concave utility functions. We present a gradient projection 
algorithm for this problem. Since the constraint set of the problem 
is described by exponentially many constraints, methods that use 
exact projections are computationally intractable. Therefore, we 
develop a new method that uses approximate projections. We use 
the polymatroid structure of the capacity region to show that 
the approximate projection can be implemented by a recursive 
algorithm in time polynomial in the number of users. We further 
propose another algorithm for implementing the approximate 
projections using rate-splitting and show improved bounds on its 
convergence time. 

I. Introduction 

Dynamic allocation of communication resources such as 
bandwidth or transmission power is a central issue in multiple 
access channels in view of the time varying nature of the 
channel and interference effects. Most of the existing literature 
on resource allocation in multiple access channels focuses on 
specific communication schemes such as TDMA (time-division 
multiple access) [1] and CDMA (code-division multiple access) 
[2], [3] systems. An exception is the work by Tse et al. [4], 
who introduced the notion of throughput capacity for the fading 
channel with Channel State Information (CSI) and studied 
dynamic rate allocation policies with the goal of maximizing 
a linear utility function of rates over the throughput capacity 
region. 

In this paper, we consider the problem of rate allocation 
, in a multiple access channel with perfect CSI. Contrary to 
the linear case in [4], we consider maximizing a general 
utility function of transmission rates over the capacity region. 
General concave utility functions allow us to model different 
performance metrics and fairness criteria (cf. Shenker [5], 
Srikant [6]). In view of space restrictions, we focus on the 
non-fading channel in this paper. In our companion paper [7], 
we extend our analysis to the fading channel. 

Our contributions can be summarized as follows. 

We introduce a gradient projection method for the problem of 
maximizing a concave utility function of rates over the capacity 

This research was partially supported by the National Science Foundation 
under grant DMI-0545910, and by DARPA ITMANET program. 

A. ParandehGheibi is with the Laboratory for Information and Decision Sys- 
tems, Electrical Engineering and Computer Science Department, Massachusetts 
Institute of Technology, Cambridge MA, 02139 (e-mail: parandeh@mit.edu) 

A. Eryilmaz is with the Electrical and Computer Engineering, Ohio State 
University, OH, 43210 (e-mail: eryilmaz@ece.osu.edu) 

A. Ozdaglar and M. Medard are with the Laboratory for Information 
and Decision Systems, Electrical Engineering and Computer Science Depart- 
ment, Massachusetts Institute of Technology, Cambridge MA, 02139 (e-mails: 
asuman@mit.edu, medard@mit.edu) 



region of a non-fading channel. We establish the convergence 
of the method to the optimal solution of the problem. Since 
the capacity region of the multiple-access channel is described 
by a number of constraints exponential in the number of users, 
the projection operation used in the method can be compu- 
tationally expensive. To reduce the computational complexity, 
we introduce a new method that uses approximate projections. 
By exploiting the polymatroid structure of the capacity region, 
we show that the approximate projection operation can be 
implemented in polynomial time using submodular function 
minimization algorithms. Moreover, we present a more efficient 
algorithm for the approximate projection problem which relies 
on rate-splitting [8]. This algorithm also provides the extra 
information that allows the receiver to decode the message by 
successive cancelation. 

Other than the papers cited above, our work is also related 
to the work of Vishwanath et al. [9] which builds on [4] and 
takes a similar approach to the resource allocation problem for 
linear utility functions. Other works address different criteria 
for resource allocation including minimizing the weighted sum 
of transmission powers [10], and considering Quality of Service 
(QoS) constraints [1 1]. In contrast to this literature, we consider 
the utility maximization framework for general concave utility 
functions. 

The remainder of this paper is organized as follows: In 
Section II, we introduce the model and describe the capacity 
region of a multiple-access channel. In Section III, we consider 
the utility maximization problem in non-fading channel and 
present the gradient projection method. In Section IV, we 
address the complexity of the projection problem. Finally, we 
give our concluding remarks in Section V. 

Regarding the notation, we denote by x\ the i-th component 
of a vector x. We denote the nonnegative orthant by R" , i.e., 
K™ = {x £ M™ | cc > 0}. We write x' to denote the transpose 
of a vector x. We use ||x|| to denote the standard Euclidean 
norm, ||ir|| = V x'x, and V(x) to denote the exact projection 
of a vector x £ K™ on a nonempty closed convex set X, i.e., 

V(x) = argmin ||x — x||. 

II. System Model 

We consider M users sharing the same media to communi- 
cate to a single receiver. We model the channel as a Gaussian 
multiple access channel with flat fading effects 

M 

Y(n) = Y, VHi(n)Xi(n) + Z(n), (1) 

i=l 

where Xi(n) are the transmitted waveform with average power 
Pi, Hi(n) is the channel gain corresponding to the 2-th user and 
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Z(n) is white Gaussian noise with variance Nq, We assume that 
the channel gains are known to all users and the receiver Q. 

We focus on the non-fading case when the channel gains are 
fixed. We assume without loss of generality that all channel 
gains are equal to unity. The capacity region of the Gaussian 
multiple-access channel is described as follows [12]: 



C a (P) 



ies its 
for all S C M = {1,...,M} },(2) 



where Pi and Ri are the j-th user's power and rate, respectively. 
C (P, N) denotes Shannon's formula for the capacity of an 
AWGN channel given by 



C(P, AT) = ilog(l + ^) 



nats. 



(3) 



III. Resource Allocation in Non-fading Channel 

Consider the following utility maximization problem in a 
ill-user non-fading multiple-access channel with channel gains 
fixed to unity. 



maximize 
subject to 



u(R) 

ReC g (P), 



(4) 



where Ri and Pi are i-th user rate and power, respectively. 
The utility function u(R) is assumed to satisfy the following 
conditions. 
Assumption 1: 

(a) The utility function u(R) is concave with respect to vector 
R. 

(b) The utility function u(R) is monotonically non-decreasing 
with respect to Ri, for i = 1, . . . , M. 

(c) There exists a scalar B such that 

llfifll < B, for all g S du(R), 

where du(R) denotes the subdifferential of u at R. 

The maximization problem in © is a convex program and 
the optimal solution can be obtained by several variational 
methods such as the gradient projection method. The gradient 
projection method with exact projection is typically user for 
problems where the projection operation is simple, i.e., for 
problems with simple constraint sets such as the non-negative 
orthant or a simplex. However, the constraint set in is 
defined by exponentially many constraints, making the pro- 
jection problem computationally intractable. To alleviate this 
problem, we use an approximate projection, which is obtained 
by successively projecting on some violated constraint. 

Definition 1: Let X = {x £ R n |Ac < 6} where A has non- 
negative entries. Let y £ K" violate the constraint a^x < bi, 
for i £ {it, . . . ,ii}. The approximate projection of y on X, 
denoted by V, is given by 

P(y)=V il (...(V il _ 1 (n(v)))), 

'This is assumption is satisfied in practice when the receiver measures the 
channels and feeds back the channel information to the users. 



where Vi k denotes the exact projection on the hyperplane {x £ 



l n \a' l x = b lk }. 



Proposition 1: The approximate projection V given in Def- 
inition Q] has the following properties: 

(i) For any y £ E™, V(y) is feasible with respect to set X, 
i.e., V(y) £X. 

(ii) V is pseudo-nonexpansive, i.e., 

Il^(y)-»ll<l|y-y||. for ally ex. (5) 

Proof: For part (i), it is straightforward to see that Vi{y) 
is given by (c.f. [13] Sec. 2.1.1) 



a\y 



Vi{y) = y 



Since a,; just has non-negative entries, all components of y are 
decreased after projection and hence, the constraint i will not 
be violated in the subsequent projections. Given an infeasible 
vector y £ W 1 , the approximate projection operation given in 
Definition Q] yields a feasible vector with respect to set X. 

Part (ii) can be verified using the nonexpansiveness property 
of projection on a convex set. Since y is a fixed point of Vi 
for all i, we have 



\Hv)-y\ 



< 



< 



\\v i A---{v il {y)))-'PiA---{Vi l m)\\ 

\\V i A---(V il {y)))-^(---{V il {y)))\\ 



\y-y\\ 



(6) 



Note that the result of approximate projection depends on 
the order of projections on violated constraints and hence it is 
not unique. The k-th iteration of the gradient projection method 
with approximate projection is given by 



R k+i = V(R k + a k g k ), g k £ du(R k ), 



(7) 



where g k is a subgradient at R k , and a k denotes the stepsize. 
The following theorem provides a sufficient condition that can 
be used to establish convergence to the optimal solution. 

Theorem 1: Let Assumption Q] hold, and R* be an optimal 
solution of problem (0J. Also, let the sequence {R k } be 
generated by the iteration in (0. If the stepsize a k satisfies 



< a k < 



2 (u(R*) - u(i? fc )) 



,fc||2 



then 



\\R k+1 -R*\\ < \\R k -R*\ 
Proof: We have 



k„k 



\R k +a k g 



R 



*l|2 



\R R 



*||2 



(8) 



(9) 



2a k {R k - R*)'g k 



+{v k ?\\g k \\ 2 . 

By concavity of u, we have 

(R* - R k )'g k > u{R*) - u(R k ). 



(10) 
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Hence, 

\\R k + a k g k - R*f 



< 



R - R 



* 1 1 2 



2[u(R*)-u(R k ) )-(a k )\\g 



,fe||2 



If the stepsize satisfies ©, the above relation yields the 
following 

||i? fe + aV--R*ll < \\R k -R*\\. 

Now by applying pseudo-nonexpansiveness of the approximate 
projection we have 

\\R k+1 -R*\\ = \\V(R k +a k g k )- R*\\ 

R*\\ < \\R k -R*\\. 



< \\R k + a k g k 



Proposition 2: Let Assumption Q] hold. Also, let the se- 
quence {R k } be generated by the iteration in (O. If the stepsize 
a k satisfies ([S]), then {R k } converges to an optimal solution 
R*. 

Proof: See Proposition 8.2.7 of [14]. ■ 
The convergence analysis for this method can be extended 
for different stepsize rules. For instance, we can employ dimin- 
ishing stepsize, i.e., 



a 



0, 



E< 

fc=0 



oo, 



or more complicated dynamic stepsize selection rules such as 
the path-based incremental target level algorithm proposed by 
Brannlund [15] which guarantees convergence to the optimal 
solution, and has better convergence rate compared to the 
diminishing stepsize rule. 

IV. Complexity of the Projection Problem 

Even though the approximate projection is simply obtained 
by successive projection on the violated constraints, it requires 
to find the violated constraints among exponentially many 
constraints describing the constraint set. In this section, we 
exploit the special structure of the capacity constraints so 
that each gradient projection step in (0 can be performed in 
polynomial time in M. 

Definition 2: Let / : 2 M — > M be a function defined over 
all subsets of M.. f is submodular if 

f(SUT)+f(SDT)<f(S)_+f(T), for all S, Te 2 M . (11) 
Proposition 3: For any R S finding the most violated 
capacity constraint in (fJJ is equivalent to a submodular function 
minimization (SFM) problem. 

Proof: Define fc(S) : 2 M -> M as follows 

fc(S) = C(J2 Pi, N Q ), for all S C M. (12) 

It is straightforward to see that fc is a submodular function. 
We can rewrite the capacity constraints in (O as 



fc(S) -^2Ri>0, for all S C M. 



(13) 



Thus, the most violated constraint at R is given by 

S*=argmin / C (5)-V^. 

g 62 -M ^— I 



ies 



Since summation of a submodular and a linear function is also 
submodular, the problem above is of the form of submodular 
function minimization. ■ 

It is first shown by Grotschel et al. [16] that SFM problem 
can be solved in strongly polynomial time. The are several fully 
combinatorial strongly polynomial algorithms in the literature. 
The best known algorithm for SFM proposed by Orlin [17] 
has running time 0(M 6 ) for the submodular function defined 
in ( fT2l . Note that approximate projection does not require 
any specific order for successive projections. Hence, finding 
the most violated constraint is not necessary for approximate 
projection. In view of this fact, a more efficient algorithm based 
on rate-splitting is presented in Appendix |IJ to find a violated 
constraint. This algorithm runs in 0(M log M) time. 

Although a violated constraint can be obtained in polynomial 
time, it does not guarantee that the approximate projection 
can be performed in polynomial time. Because it is possible 
to have exponentially many constraints violated at some point 
and hence the total running time of the projection would be 
exponential in M. However, we show that for small enough 
stepsize in the gradient projection iteration Q, no more than 
M constraints can be violated at each iteration. Let us first 
define the notion of expansion for a polyhedron. 

Definition 3: Let Q be a polyhedron described by a set of 
linear constraints, i.e., 



Q = {x e E™ : Ax < b} . 



(14) 



Define the expansion of Q by S, denoted by £s{Q), as the 
polyhedron obtained by relaxing all the constraints in ( fT4b . i.e., 
£ S (Q) = {x e M" : Ax < b + 61} , where 1 is the vector of 
all ones. 

Lemma 1: Let fc be as defined in d!21 l. There exists a 
positive scalar 8 satisfying 

S < l(fc(S) + fc(T)-fc(SnT)-f c (SUT)), 

for all S, T e 2 M , SnT^S,T, (15) 

such that any point in the relaxed capacity region of an M- 
user multiple-access channel, £g(C g ), violates no more than 
M constraints of C g defined in ©. 

Proof: Existence of a positive scalar S satisfying ( fT~5T > 
follows from submodularity of fc, and the fact that neither S 
nor T contains the other one. 

Suppose for some R e £g(C g ), there are M + 1 constraints 
of C g violated. There are at least two violated constraints 
corresponding to some sets S, T S 2 M where S flT ^ S,T. 
Because it is not possible to have M+l non-empty nested sets 
in 2 M . We have 



R; 



ies 



E 

ies 



< 



< 



-fc(S), 
-fc(T). 



(16) 



(17) 
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Since R is feasible in the relaxed region, 

£ * ^ fc(snT) + s, 



(18) 
(19) 



£ ^ ^ fc(SUT) + 6. 

ieSuT 

Note that if S H T = 0, (USJ reduces to < S which is a valid 
inequality. 

By summing the above inequalities we conclude 

6 > \(fc(S) + fc(T) - f c (S n T) — f c (S U T)), (20) 

which is a contradiction. ■ 
Theorem 2: Let Assumption Q] hold. Let P% < P2 < . . . < 

Pm be the transmission powers. 

If the stepsize a k in the fc-th iteration (|7]i satisfies 



< 



1 



4BVM 



log 



1 



P1P2 



(No + EtLsPM + EtLiPi) 



then at most M constraints of the capacity region C g can be 
violated at each iteration step. 

Proof: We first show that the inequality in (15[ holds for 
the following choice of 8: 



5= -log 



P1P2 



In order to verify this, rewrite the right hand side of ( fl3T > as 

(JVo + EiesWVo + Eigr^) 



~ log 



= ~log 
>^log 
>^log 



> Z log 



(^o + Eigsnr-PO^o+E 
1 



gsut Pi) 

S(i,j)e(S\T)x(T\S) 



snT SUT 

P1P2 



(No + E ie A-X^o + E 
PiP 2 



iS SUT P>) 



(^o + E ie snT^)(^o + E;=iPi) 



The inequalities can be justified by using the monotonicity 
of the logarithm function and the fact that (S \T) x (T \ S) is 
non-empty because S D T 7^ S, T. 

Now, let R k be feasible in the capacity region, C g . For every 
S C A'J, we have 



.fc„fc 



iGS 



) = E^+« fc iis fe ii£|, ,| 

ies ies l|y 1 



.9? 



— IIP" 



(21) 



where the first inequality follows from the hypotheses and the 
second inequality follows from the fact that for any unit vector 
d € R M , it is true that 



Y,d t <^2\di\ < vm. 



(22) 



Thus, if a k satisfies (ED then (R k +a k g k ) € ^(C s ), for some 
<5 for which dl~5T > holds. Therefore, by Lemma [T] the number of 
violated constraints does not exceed M. ■ 
In view of the fact that a violated constraint can be identified in 
0(M 2 \ogM) time (see the Algorithm in Appendix I), Theo- 
rem E] implies that, for small enough stepsize, the approximate 
projection can be implemented in 0(M 3 log M) time. 

V. Conclusion 

We addressed the problem of optimal rate allocation in a non- 
fading multiple access channel from an information theoretic 
point of view. We formulated the problem as maximizing a 
general concave utility function of transmission rates over the 
capacity region of the multiple-access channel. 

We presented an iterative gradient projection method for 
solving this problem. In order to make the projection on a 
set defined by exponentially many constraints tractable, we 
considered a method that uses approximate projections. Using 
the special structure of the capacity region, we showed that the 
approximate projection can be performed in time polynomial 
in the number of users. 

In ongoing work, we extend our analysis to finding dynamic 
resource allocation policies in fading multiple-access channels. 
We study both rate and power allocation policies under different 
assumptions on the availability of channel statistics information. 

Appendix I 

Algorithm for finding a violated constraint 

In this section, we present an alternative algorithm based 
on rate-splitting idea to identify a violated constraint for an 
infeasible point. For a feasible point, the algorithm provides 
information for decoding by successive cancellation. We first 
introduce some definitions. 

Definition 4: The quadruple (M, P, R, Nq) is called a con- 
figuration for an M-user multiple-access channel, where R — 
(Ri, . . . , Rm) is the rate tuple, P = (Pi, . . . , Pm) represents 
the received power and No is the noise variance. For any given 
configuration, the elevation, S £ K M , is defined as the unique 
vector satisfying 

R i = C(Pi,N + S i ), i = l,...,M. (23) 
Intuitively, we can think of message i as rectangles of height 
Pi, raised above the noise level by 6i. In face, Si is the amount 
of additional Gaussian interference that message i can tolerate. 
Note that if a configuration is feasible then its elevation vector 
is non-negative, but that is not sufficient to check feasibility. 

Definition 5: The configuration (A/, P, R, Nq) is single- 
user codable, if after possible re-indexing, 



> Si +P h i = 0,1,. 



,M- 1, 



(24) 



ies 



lES 



where we have defined <5o = Po = for convention. 
By the graphical representation described earlier, a configu- 
ration is single-user codable if the none of the messages are 
overlapping. 
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Definition 6: The quadruple (m,p,r, Nq) is a spin-off of 
(M, P, R, Nq) if there exists a surjective mapping <fi : 
{l,...,m} -> {1, . . . , M} such that for all i G {1, . . . ,M} 
we have 

Pi > E w> 
Ri < E r ^ 

where </> _1 (i) is the set of all j € {1, ... , to} that map into i 
by means of <j>. 

Definition 7: A hyper-user with power P, rate R, is obtained 
by merging d actual users with powers (Pi 1 , . . . , Pi d ) and rates 
(R il ,...,R id ), i.e, 

<Z d 

p = Y,p*> #=E^- ^ 

fe=l fe=l 

Proposition 4: For any M-user achievable configuration 
(M, P, R, Nq), there exists a spin-off (to, p, r, Nq) which is 
single user codable. 

Proof: See Theorem 1 of [8]. ■ 
Here, we give a brief sketch of the proof to give intuition about 
the algorithm. The proof is by induction on M. For a given 
configuration, if none of the messages are overlapping then 
the spin-off is trivially equal to the configuration. Otherwise, 
merge the two overlapping users into a hyper-user of rate and 
power equal the sum rate and sum power of the overlapping 
users, respectively. Now the problem is reduced to rate splitting 
for (M — 1) users. This proof suggests a recursive algorithm 
for rate-splitting that gives the actual spin-off for a given 
configuration. 

It follows directly from the proof of Proposition [4] that this 
recursive algorithm gives a single-user codable spin-off for an 
achievable configuration. If the configuration is not achievable, 
then the algorithm encounters a hyper-user with negative eleva- 
tion. At this point the algorithm terminates. Suppose that hyper- 
user has rate R and power P. Negative elevation is equivalent 
to the following 

R > C(P,N ). 
Hence, by Definition [7] we have, 

Y,Pi>C(J2Pi,N ). 

where S = {i±, . . . ,id} Q M.- Therefore, a hyper-user with 
negative elevation leads us to a violated constraint in the initial 
configuration. 

The complexity of this algorithm can be computed as fol- 
lows. The algorithm terminates after at most M recursions. 
At each recursion, all the elevations are computed in 0(M) 
time and they are sorted in 0(M log M) time. Once the users 
are sorted by their elevation it takes 0(M) time to either find 
two overlapping users or a hyper-user with negative elevation. 
Hence, the algorithm runs in 0(M 2 log M) time. 



References 

[1] X. Wang and G.B. Giannakis. Energy-efficient resource allocation in time 
division multiple-access over fading channels. Preprint, 2005. 

[2] S.J. Oh, Z. Danlu, and K.M. Wasserman. Optimal resource allocation in 
multiservice CDMA networks. IEEE Transactions on Wireless Commu- 
nications, 2(4):81 1-821, 2003. 

[3] J.B. Kim and M.L. Honig. Resource allocation for multiple classes of DS- 
CDMA traffic. IEEE Transactions on Vehicular Technology, 49(2):506- 
519, 2000. 

[4] D. Tse and S. Hanly. Multiaccess fading channels part I: Polymatroid 
structure, optimal resource allocation and throughput capacities. IEEE 
Transactions on Information Theory, 44(7):2796-2815, 1998. 

[5] S. Shenker. Fundamental design issues for the future internet. IEEE 
Journal on Selected Areas in Communications, 13:1176-118, 1995. 

[6] R. Srikant. Mathematics of Internet Congestion Control. Birkhauser, 
2004. 

[7] A. ParandehGheibi, A. Eryilmaz, A. Ozdaglar, and M. Medard. Rate 
and power allocation in fading multiple access channels. Proceedings of 
WiOpt, 2008. 

[8] B. Rimoldi and R. Urbanke. A rate- splitting approach to the gaussian 

multiple-access channel. IEEE Transactions on Information Theory, 

42(2):364-375, 1996. 
[9] S. Vishwanath, SA. Jafar, and A. Goldsmith. Optimum power and rate 

allocation strategies for multiple access fading channels. In Proceedings 

of IEEE VTC, 2001. 
[10] D. Yu and J.M. Cioffi. Iterative water-filling for optimal resource alloca- 
tion in OFDM multiple-access and broadcast channels. In Proceedings 

of IEEE GLOBECOM, 2006. 
[11] K. Seong, R. Narasimhan, and J. Cioffi. Scheduling for fading multiple 

access channels with heterogeneous QoS constraints. In Proceedings of 

International Symposium on Information Theory, 2007. 
[12] T.M. Cover and J. A. Thomas. Elements of Information Theory. John 

Wiley and Sons, Inc., New York, New York, 1991. 
[13] D.P Bertsekas. Nonlinear Programming. Athena Scientific, Cambridge, 

Massachusetts, 1999. 
[14] D.P. Bertsekas, A. Nedic, and A.E. Ozdaglar. Convex Analysis and 

Optimization. Athena Scientific, Cambridge, Massachusetts, 2003. 
[15] U. Brannlund. On relaxation methods for nonsmooth convex optimization. 

Doctoral thesis, Royal Institute of Technology, Stockholm, Sweden, 1993. 
[16] M. Grotschel, L. Lovasz, and A. Schrijver. The ellipsoid method and its 

consequences in combinatorial optimization. Combinatorica, 1 (2): 169— 

197, 1981. 

[17] J. Orlin. A faster strongly polynomial time algorithm for submodular 
function minimization. In Proceedings of the 12th Conference on Integer 
Programming and Combinatorial Optimization, pages 240-251, 2007. 



